SQuAD Question Answering Problem : A match-lstm implementation
نویسنده
چکیده
As a first experience in neural network modeling, and tensor flow usage, we try to implement a match-LSTM attention model, which is known for achieving interesting results on the SQuaD dataset leader board.
منابع مشابه
CS224n PA4: Extending Match-LSTM
We propose two novel extensions to the Match-LSTM Boundary model for question answering on the SQuAD dataset. First we propose doing attention in the passage and question encoders. Second we propose adding a one-way conditional dependency between start-of-span and end-of-span prediction. In our evaluations, we show that these extensions result in a model that outperforms our implementation of v...
متن کاملImplementation and Analysis of Match-LSTM for SQuAD
Wang and Jiang recently proposed an end-to-end neural system solving the Stanford Question Answering Dataset (SQuAD) task [1]. The model consists of their textual entailment model called Match-LSTM, and a new sequence model for finding answers in context paragraphs. We reimplemented the model using Keras and Tensorflow [2][3]. Although we were not able to reproduce the original system’s accurac...
متن کاملImproving Match-LSTM for Machine Comprehension
Machine comprehension is a critical problem that lies on the frontier of natural language processing. The Stanford Question Answering Dataset (SQuAD), offers a set of questions and their answers created by humans through crowdsourcing. We implemented an end-to-end neural architecture for the task based on MatchLSTM and Pointer Net, inspired by previous work done by Wang and Jiang in Machine Com...
متن کاملAn Exploration of Approaches for the Stanford Question Answering Dataset
In this paper, we present an exploration of several approaches of varying complexity, novelty and effectiveness applied to solving the reading comprehension problem evaluated by the Stanford Question Answering Dataset (SQuAD), taken from the perspective of a novice practitioner of Deep Neural Networks for Natural Language Processing. Here, we present several models, their mathematical structure...
متن کاملAttention-based Recurrent Neural Networks for Question Answering
Machine Comprehension (MC) of text is an important problem in Natural Language Processing (NLP) research, and the task of Question Answering (QA) is a major way of assessing MC outcomes. One QA dataset that has gained immense popularity recently is the Stanford Question Answering Dataset (SQuAD). Successful models for SQuAD have all involved the use of Recurrent Neural Network (RNN), and most o...
متن کامل